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ABSTRACT 

An  abstract  approximation  framework  for  the  solution  of  operator  algebraic  Riccati 
equations  is  developed.  The  approach  taken  is  based  upon  a  formulation  of  the  Riccati 
equation  as  an  abstract  nonlinear  operator  equation  on  the  space  of  Hilbert-Schmidt  opera¬ 
tors.  Hilbert-Schmidt  norm  convergence  of  solutions  to  generic  finite  dimensional  Galerkin 
approximations  to  the  Riccati  equation  to  the  solution  of  the  original  infinite  dimensional 
problem  is  argued.  The  application  of  the  general  theory  is  illustrated  via  an  operator  Ric¬ 
cati  equation  arising  in  the  linear-quadratic  design  of  an  optimal  feedback  control  law  for  a 
one  dimensional  heat/diffusion  equation.  Numerical  results  demonstrating  the  convergence 
of  the  associated  Hilbert-Schmidt  kernels  are  included. 
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ON  HILBERT-SCHMIDT  NORM  CONVERGENCE  OF 
GALERKIN  APPROXIMATION  FOR  OPERATOR 
RICCATI  EQUATIONS 

I.G.  Rosen 


Abstract.  An  abstract  approximation  framework  for  the  solution  of  operator  algebraic 
Riccati  equations  is  developed.  The  approach  taken  is  based  upon  a  formulation  of  the 
Riccati  equation  as  an  abstraict  nonlinear  operator  equation  on  the  space  of  Hilbert- 
Schmidt  operators.  Hilbert-Schmidt  norm  convergence  of  solutions  to  generic  finite 
dimensional  Galerkiu  approximations  to  the  Riccati  equation  to  the  solution  of  the 
original  infinite  dimensional  problem  is  argued.  The  application  of  the  general  theory 
is  illustrated  via  an  operator  Riccati  equation  arising  in  the  linear-quadratic  design 
of  an  optimal  feedback  control  law  for  a  one  dimensional  heat /diffusion  equation. 
Numerical  results  demonstrating  the  convergence  of  the  associated  Hilbert-Schmidt 
kernels  are  included. 


1.  Introduction 

In  this  paper  we  develop  an  abstract  approximation  theory  for  algebraic  Riccati 
equations  on  spaces  of  Hilbert-Schmidt  operators.  Our  approach  is  based  upon 
Barbu’s  [1]  formulation  of  a  class  of  Riccati  equations  as  abstract  nonlinear  operator 
equations  on  a  space  of  Hilbert-Schmidt  operators.  We  argue  that  solutions  to 
generic  finite  dimensional  Galerkin  approximations  to  the  Riccati  equation  converge 
in  Hilbert-Schmidt  norm  to  the  solution  of  the  original  infimte  dimensional  equation. 

Our  effort  here  is  closely  related  to  results  in  one  of  our  earlier  papers  [6]  wherein 
we  developed  an  approximation  theory  for  operator  Riccati  differential  equations 
using  techniques  similar  to  those  which  will  be  employed  below.  Our  treatments 
here  and  in  [6]  differ  from  the  standard  approach  to  the  analysis  of  operator  Ric¬ 
cati  equation  approximation  in  that  we  consider  the  nonlinear  operator  equations 
directly  in  the  space  of  Hilbert-Schmidt  operators  rather  than  integral  equation 
equivalents  and  their  limiting  properties  as  the  time  horizon  tends  to  infinity  (see, 
for  example,  [3]).  While  we  do  in  fact  obtain  a  stronger  convergence  result  than  the 
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ones  yielded  by  the  standard  approach,  the  class  of  probelms  to  which  our  theory 
applies  is  somewhat  more  restricted. 

In  section  2  we  briefly  outline  and  summarize  Barbu’s  [1]  results  for  opeator 
algebraic  Riccati  equations  on  spaces  of  Hilbert-Schmidt  operators.  Om  approxi¬ 
mation  results  are  then  given  in  section  3.  The  convergence  arguments  given  there 
depend  heavily  upon  a  factorization  result  for  Hilbert-Schmidt  operators  and  its 
subsequent  imphcations  regarding  the  convergence  of  Galerkin  approximations.  In 
the  fourth  section  we  discuss  the  application  of  our  results  to  a  Riccati  equation 
arising  in  the  linear-quadratic  design  of  an  optimal  feedback  control  law  for  a  one 
dimensional  heat /diffusion  equation.  Numerical  results  illustrating  the  convergence 
of  spline-based  approximations  are  also  presented. 

2.  Operator  Algebraic  Riccati  Equations  in  Spaces  of 
Hilbert-Schmidt  Operators 

A  rather  complete  existence  theory  for  solutions  to  operator  algebraic  Riccati 
equations  can  be  found  in  Barbu’s  book  [1].  We  provide  a  brief  outline  of  those 
results  here.  Barbu’s  theory  forms  the  basis  for  the  approximation  and  convergence 
results  which  will  be  developed  in  the  subsequent  section  below. 

Let  if  be  a  real  separable  Hilbert  space  with  inner  product  (•,•)  and  associated 
induced  norm  |  •  ].  Let  V  also  be  a  real  separable  Hilbert  space  with  inner  product 
<  •,•  >  and  corresponding  norm  ||  •  ||.  We  assume  that  V  is  densely,  continuously, 
and  compaetly  embedded  in  H.  Indentifying  H  with  its  dual,  H*,  we  have  V  <— > 
H  =  H*  V*  with  the  final  embedding  dense  and  continuous  as  well.  If  we  let 
11  •  11,  denote  the  standard  operator  norm  on  F*,  then  the  continuity  of  the  above 
embeddings  imply  the  existence  of  a  constant  //  >  0  for  which  \if  \  <  A'liv’Hi  e  F, 
and  11(/?11,  <  n\ipl  €  H. 

Let  7  e  £(F,  F*)  denote  the  canonical  isomorphism  (Riesz  map)  from  F  onto 
F*.  That  is,  for  e  F,  (7^’,^/’)  =<  >,  where  in  this  case  (•,•)  denotes  the 

usual  extension  of  the  H  inner  product  to  the  duality  pairing  between  F  and  F*. 
It  follows  that  7“^  e  £(F*,  F)  fl  C{H,  F)  is  self-adjoint,  positive,  and  compact  as  a 
mapping  from  H  into  H.  With  inner  product  <  •,  •  >,  given  by 

<(p,xp  >.=<  7~V>7"V  >=  e  F*, 

V*  is  a  Hilbert  space  with  11</p11,  =  ip,(p  >,,  for  ip  e  V*.  The  mapping  7“*  being 
self-adjoint,  positive,  and  compact  on  H  yields  the  existence  of  an  orthonormal 
basis  for  H  such  that  7“^eit  =  k  =  1,2,...  with  p/t  >  0,  k  = 

1,2,....  It  follows  that  and  {pk^k}  are  orthonormal  bases  for  F  and 

F*  respectively. 

Let  HS{X,Y)  denote  the  Hilbert  space  of  Hilbert-Schmidt  operators  defined 
on  the  separable  Hilbert  space  X  with  range  in  the  separable  Hilbert  space  Y. 
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Let  [•,  ■]hs{X,Y)  and  )  •  )//s(x,y)  denote  the  usual  Hilbert- Schmidt  inner  product 
and  corresponding  induced  norm  on  HS(X,Y).  Let  H  =  HS{H,H)  with  [•,•]«  = 

1  •  \hs(H,H)  and  let  V  =  HS(V*,H)  D  HS(H,V)  with  [^-Jv  =  [•, -Ihscv,//)  + 
[■>  •]//S(//,V)  and  |j$||v  =  $]v»  for  $  c  V.  The  space  V  together  with  the 

innerproduct  [•,  -Jy  is  a  Hilbert  space.  Moreover  it  can  be  argued  that  the  inclusions 
HS{V%H)  C  HS{H,H)  C  HS{V,H)  and  HS{H,V)  C  HS{H,H)  C  HS{H,V*) 
are  dense  and  continuous  and  that  HS{V*,H)  and  HS(V,H)>  and  HS(H,V)  and 
HS{H,V*)  axe  dual  pairs  with  respect  to  the  duality  pairing  derived  from  the  7i 
inner  product,  [•,•]><.  Consequently  we  have  V*  =  HS{V,H)  -f  HS{H,V*),  and 
identifying  7i  with  its  dual,  the  dense  and  continuous  embeddings  V  7i  =  Ti*  ^ 
V*. 

Let  a(-,-)  :  V  xV  — >  R  be  a  bounded,  strongly  V-elliptic  bilinear  form.  More 
precisely,  we  assume  that  there  exist  positive  constants  a  and  (3  for  which  a(<^,  v?)  > 
^  V  and  |a(v5,V’)|  <  0\W\\  ||«/'||,  e  V.  Let  A  e  £(F,  F*)  be  the 
operator  defined  by  =  a(v3,^),  ip,x/)  e  V.  Let  a*(-,-)  :  F  x  F  -+  R  be 

the  form  adjoint  to  a(-,-)-  That  is  a*(v?,V’)  =  a(?/>,iyS>),  e  F.  It  follows  that 

>  allv3l|^,(^  €  F  and  |a*(v?,V’)|  <  ^\\if\\  Ijj/’H,  eV.  Let  A*  e  C{V,V*) 
be  the  operator  defined  by  (A*(^,‘ip)  =  a*{ip  ip),  i^,ip  e  V.  Then,  if  we  define  the 
operators  A  :  Dom(A)  Q  H  ^  H  and  A*  :  Dom(A*)  C  H  H  to  he  the  re¬ 
strictions  of  the  operators  A  and  A*  to  the  sets  Dom{A)  =  {(p  e  V  :  A<p  t  H) 
and  Dom{A*)  =  {y?  €  F  :  A*<p  e  H}  respectively,  it  can  be  argued  that  A  and 
A*  are  densely  defined  and  are  H-adjoints  of  one  another.  That  is  {Aif,xp)  = 
{(p,Atp),ip  €  Dom{A),  Ip  €  Dom{A*). 

Define  the  closed  convex  cone  C  in  by  C  =  {$  e  HS{H,  H)  :  $  =  $*,  $  >  0} 
and  let  $  — >  be  a  single  valued  mapping  defined  for  every  ^  e  C  with  range 

in  H  which  is  continuous  from  H  into  itself.  (Such  a  mapping  B  can  be  defined  via 
the  operational  calculus  for  bounded  linear  operators  by  H($)  =  /(^),  $  e  C,  where 
/  is  a  single  valued  complex  function  of  a  complex  variable  satisfying  /(O)  =  0  and 
which  is  analytic  on  the  nonnegative  real  axis  (see  Dunford  and  Schwartz,  Part  II 
[2],  Theorem  XI.  6.7.7).)  We  eissume  that  B  is  bounded  and  monotone  on  C.  That 
is  that  it  maps  T-t  —  bounded  subsets  of  C  into  7i  —  bounded  subsets  and  that  it  has 
the  property 

(2.1)  fB($)-H('J'),$-^]^  >0 

for  every  e  C.  We  assume  further  that 

(2.2)  {I  +  XB)CdC,  A>0. 

Let  0  e  C  be  given,  and  we  consider  the  generalized  algebraic  Riccati  equation  for 
n  e  "H  given  by 

(2.3)  A*n  +  n^  +  H(n)  =  0. 
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We  seek  a  solution  11  e  C  to  (2.3).  We  note  that  for  n  a  positive  integer,  the 
operator  B  given  by  5($)  =  $  e  C  {i.e.f(z)  =  2")  can  be  shown  to  satisfy  the 

conditions  above.  Indeed,  boundedness  follows  from  the  esitmate 
while  monotonicity  can  be  established  via 

n 

J=1 

for  e  C  (see  [9]).  Finally,  for  'if  eC  and  A  >  0  let  {0,}^2  be  the  orthonormal  set 
of  eigenvectors  of  with  corresponding  eigenvalues  (The  fact  that  if  e  C 

implies  >  0,  i  =  1,2, . . . ).  Then,  if  we  let  7^  denote  a  nonnegative  solution  to 
the  equation  7i  +  A7”  —  Oj  =  0  (the  intermediate  value  theorem  guarantees  that 

00 

such  a  7i  exists  with  0  <  7^  <  Oi)  and  set  ^  7i(¥’,  p  e  H,  it  follows 

»=i 

that  $  e  C  and  $  +  A$"  =  This  establishes  (2.2).  When  n  =  2,  (2.3)  becomes 
the  familiar  quadratic  Riccati  equation. 

Define  the  operator  A  e  £(V,V*)  by 

+  ^A,  $  e  V. 

It  can  be  argued  (see  [1])  that  A  is  strongly  V— elliptic  -  that  is  there  exists  a 
constant  w  >  0  for  which 

(2.4)  >u;|l$||2,  $eV. 

If  we  define  the  subspace  Dom{A)  =  {#  e  V  :  A^  e  1-1}  then  it  follows  (see  [8]) 
that  the  operator  A  :  Dom{A)  C  H  —*  H  is  densely  defined  and  m-accretive  in 
H.  With  the  above  definitions  the  problem  of  finding  a  solution  to  the  operator 
algebraic  Riccati  equation  (2.3)  becomes  one  of  finding  a  solution  11  e  Dom{!F)  to 
the  abstract  nonlinear  operator  equation  in  1-L  given  by 

(2.5)  .;"(n)  =  0 

where  0  e  £  is  given  and  !F  :  Dom{^)  C  H  — >  H  is  the  operator  defined  by 
J-{^)  —  A^  +  B(<^)  for  $  €  Dom(jF)  =  C  Cl  Dom(A). 

Using  a  standard  fixed  point  argument  on  the  closed  convex  subset  C,  Barbu  [1] 
argues  that  the  equation 

rx(^x)  =  0 

ha.s  a  unique  solution  c  Dom{^)  for  each  A  >  0  where  J-x  :  Dom{iF)  (ZH  H  is 
the  Yosida  -like  approximation  to  T  given  by  J-\  =  >1-|-A“^{/  —  (/-f  AB)“^ }.  Then 
using  the  boundedness  and  montonicity  of  B,  Barbu  argues  further  that  the  IIa 
converge  in  W  as  A  —>  0  to  an  opeator  11  e  Dom{T)  which  is  a  solution  to  (2.5)  (or, 
equivalently,  (2.3)).  The  strong  V— ellipticity  of  A  (i.e.  (2.4)),  and  the  monotonicity 
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of  B  (i.e.  (2.1))  are  then  used  in  the  usual  way  to  establish  the  uniqueness  of  11. 
Note  that  11  e  Dcym{JF)  impUes  that  11  e  C,  i.e.  that  it  is  a  nonnegative,  self-adjoint 
opeator  in  'H,  and  that  11  e  V  with  ^11  =  j4*n  -1-  HA  c  H. 

3.  Galerkin  Approximation  and  Convergence  Theory 

For  each  n  =  1,2... let  Hn  be  a  finite  dimensional  subspace  of  H  with  C  F, 
n=l,2,...  .  Let  P„  :  H  Hn  be  the  orthogonal  projection  of  H  onto  Hn  with 
respect  to  the  (•,  •)  inner  product  on  H.  We  assume 

(3.1)  lim  \\Pn<p  -  v?||  =  0,  v?  c  V. 

n— foo 

Note  that  assiunption  (3.1)  implies  that  lim  \P„ip  —  i^|  =  0,  (p  e  H,  and  that  the 

n— *00 

P„  are  uniformly  bounded  in  the  uniform  operator  topologies  on  C{H)  and  C{V). 

Lemma  3.1  The  operators  Pn  admit  extensions,  which  we  shall  again  call  Pn,  to 
idempotent,  tmiformly  bounded  operators  in  £(F*).  Moreover,  lim  \\Pn^  ~  'y^lL  = 

n— ►oo 

eV*,  the  V*-adjoint  (i.e.  the  operator  P*  satisfying  <  PnP,  fp  >♦  =  <  V’,  P^V’  >» 
c  V*)  is  given  by  P*  =  yPn'r~^ ,  and  lim  ||P*(^  -  ¥^||,  =  0,v?  e  V*. 

n— ►oo 

Proof  For  p  e  V*  set  P„v?  =  where  (pn  is  the  representer  of  the  fimctional  on 
Hn  which  is  the  restriction  of  <p  to  P„.  That  is  (<Pn>0n)  =  (^nV’i^n)  = 
tpn  €  Hn-  It  is  clear  that  Pn  as  given  above  is  a  well  defined  extension  of  the 
orthogonal  projection  of  H  onto  ff„  and  that  it  is  idempotent.  Moreover,  since 
Hn  C  V  C  V*,  for  (^  €  F*  we  may  consider  PnP  =  Pn  ^  Hn  an  element  in  V* 
via  the  duality  pairing  (P„(/?,V^)  =  (yj„,V’),  tp  e  V.  Then  for  p  e  V* ^tp  e  V,  and 
Pn  =  PnP  we  have  (Pnp.tp)  =  {pn.fp)  =  {pn-,  Pn4’)  =  {p,Pn'ip)-  Consequently  for 
e  F*  we  have 

Il'PnV^L  =  sup  \{PnP,-(p)\  =  sup  l(v?,P„0)|  <  |b||.||P„(|, 

ipeV  V’eV 

or  ||PnlU  ^  ll-Pn||-  Thus  assumption  (3.1)  implies  that  the  Pn  are  uniformly  bounded 
in  £(F*).  (We  note  that  alternatively  the  same  extension  of  the  projections  P„  to 
operators  on  F*  could  have  been  obtained  by  using  the  standard  approach  based 
upon  the  density  of  H  in  F*  and  the  usual  extension  construction  in  terms  of  limits.) 
Now  for  p  e  H  we  have 

<  P„<^,0  >*=  (Pn<^,7~V)  =  {‘f,Pnl/~^^)  =  (9,7“W^’n7~V) 

=  <  <^,7Pn7“V  >*, 

and  consequently  that  the  F*-adjoint  of  Pn,P^,  is  given  by  P*  =  7P„7“F  Finally, 
assumption  (3.1)  yields 

lim  \\Pnp-<-ph=  lim  ||7“^T’>  -  7"Vi| 

n— *oo  n— ►oo  '* 
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=  Urn  Ih  ^'fPnl  V-7  Vll 

n— ►oo  "  " 

=  lim  ||P„7“V  -  7“V|1  =  0 
for  each  (p  e  V*  and  the  lemma  is  proved. 

Define  the  sequence  of  finite  dimensional  subspaces  'H„,n  =  1, 2, ...  of  H  by 

nn  =  {^nPn:^neC{Hn)}. 

Clearly  H„  finite  dimensional  implies  that  all  operators  in  are  of  finite  rank  and 
thus  that  Tin  is  a  subspace  of  both  Ti  and  V.  For  each  n  =  1,2,...  let  Cn  C  Tin 
be  the  closed  convex  cone  given  by  =  {$„P„  e  Tin  ■  >  0}. 

Note  that  C„  C  C,n  =  1,2,..-  We  define  Galerkin  approximations  to  the  operator 
T^Tn  '■  Dom{Tn)  C  Tin  -*  '^ni  as  follows; 

(3.2)  P„($„P„)  =  {A^nPn  +  P($„Pn)}|w„,  for  $„P„  £  Dom(P„)  =  Cn. 

That  is,  for  $„Pn  e  Cn,  ^n(^nPn)  =  '^nPfi  c  Tin  where  ^„Pn  is  that  element 
in  Tin  (guaranteed  to  exist  and  be  unique  by  the  Riesz  Representation  Theorem 
applied  to  the  functional  A^nPn  +  B{^nPn)  c  V*  restricted  to  a  fimctional  on  the 
finite  dimensional  Hilbert  space  Tin)  which  satisfies  [>1$„P„  +  B{^nPn),  XnPn]n  = 
Xn-Ffilw?  XtiPn^'^n- 

It  is  of  some  vedue  to  note  that  the  approximations  to  T  given  in  (3.2)  are  the 
same  ones  that  would  be  obtained  via  the  standard  approach  which  is  based  upon 
the  replacement  of  the  operators  A  and  B  in  (2.3)  by  their  respective  Galerkin 
approximations  on  and  Tin-  Indeed,  for  each  n  =  1,2,...  define  the  operators 
An  c  C{Hn)  and  Bn  ■  C„  C  Tin  — >  “Hn  by  An<Pn  =  ’/’n,  where  for  Pn  e  Hn,  is  that 
element  in  which  satisfies  {Apn,Xn)  =  (V’n,Xn),  Xn  e  P„,  and  H„($„P„)  = 
P„P($„Pn)P„.  From  the  fact  that  P„  is  the  orthogonal  projection  of  H  onto 
it  follows  that  [$P„,’I'„]7<  =  for  every  $  e  V*  and  e  Tin-  Then,  for 

$„P„,  ^nPn  c  Hn  we  have 

[P„($„P„),  ^'„P„]^  =  +  Bi^nPn^^nPnU 

=  [M$„P„  +  H($„P„)}P„,  ■<i!nPn]n 
=  [A*$„P„  +  ^nPnAPn  +  P($„P„)P„,  'I'nP„]« 

oo 

=  E  {(A*$„P„efc,^„P„ejt)  +  (^nF„AP„efc,’J'„P„efc) 

k=l 

+(B($„P„)P„ejt,  ’i'„P„efc)} 

OO 

=  E  {(^n^nPn€fe,^nPnefc)  +(>ln-Pnefc,  ^oPnCfc) 
k=l 

+(PnH($„P„)P„eifc,  ^„P„efc)} 

OO 

=  E  +  ^nA„  +  Bni^nPn)  ]  -PnCfc ,  ^nPriCfc), 

fc=l 
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or, 


^„($nPn)  =  +  ^n-4„  +  Bni^nPn)]  Pn- 

In  the  particular  case  when  B{^)  =  for  example,  the  operators  take  the 

form  ^n($„P„)  =  +  $„v4„  +  Pn- 

Set  0„  =  P„0Pn  e  Cn  and  consider  the  problem  of  finding  a  solution  Iln  e  C„  to 
the  nonlinear  operator  equation 

(3.3)  Pn{n„)  =  0„ 

in  Tin-  Arguments  similar  to  those  described  in  section  2  above  yield  that  for  each  n 
=  1,2,...,  the  equaiton  (3.3)  admits  a  unique  solution  n„  e  Cn-  We  shall  argue  that 
lim  lllln  —  nilv  =  0;  that  is,  that  the  n„  converge  in  the  V-Hilbert-Schmidt  norm 

tt — ►©© 

to  the  solution  11  to  the  equation  (2.5)  (or  equivalently  (2.3)).  In  order  to  do  this 
we  shall  require  the  following  lemmas. 

Lemma  3.2  If  is  an  absolutely  summable  sequence  of  real  munbers,  then 

there  exist  sequences  and  {cJ^j  for  which  lim  bi  =  0,  {ci}“  j  is  absolutely 

t— ►OO 

summable,  and  a,  =  b,Ci,  i  =  1,2,.... 

OO 

Proof  Set  o  =  l^«l  ^d,  for  j  =  0,1,2,...  define  the  nonnegative  integers  kj  by 

i=l 

fco  =  0  and  for  j  =  1,2,...  let  kj  be  the  first  index  for  which 


Then  setting  bi  =  l/j  and  Ci  =  for  i  =  +  1, . . .  ,fcj,  j  =  1,2,...,  we  have 

biCi  =  flj,  i  =  1,2,...,  lim  bi  =  0,  and 

I— ►OO 

OO  OO  kj  OO  (  fcj  1 

T,\ci\=Ej  E  E  a4 

i=i  j=i  ib=fcj_,+i  i=i  [fe=i  jfc=i  J 

fci  r 

<  E  Ofc  +  x;  7  {«  -  («  -  U^)} 

ifc=l  j=2  ^  ) 

OO  OO 

j=i  j=i 

Lemma  3.3  Let  X  and  Y  be  real  separable  Hilbert  spaces  with  inner  products 
denoted  by  <  >x  and  <  >y  respectively.  Then  every  $  e  HS{X,Y)  can  be 
written  in  factored  form  as  $  =  ^  C{Y)  compact  and  e  HS{X,Y). 


Proof  Let  be  an  orthonormal  basis  for  X  and  let  be  an  orthonormal 

basis  for  Y.  If  $  c  P^5(A’,  F)  then  it  has  a  representation  in  the  form  of  an  infinite 
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matrix  $  ♦-»  [cpij]  where  ip^j  =<  >y,  and  Yi  ^  <  oo-  Now  for  i  =  1,2,... 

.=1  j=i 

OO 

set  Qi  =  Y  The  sequence  is  absolutely  summable,  so  applying  Lemma 

>=i 

3.2  we  obtain  sequences  and  {c,}~j  for  which  a,  =  6,c,,  i  =  1,2,...,  lim  6,  = 

t— fOO 

OO  OO  OO 

0,  and  Y  kil  =  E  c.  <  OO.  Define  e  C{Y)  by  =  E  <  y»y.  >V'  Vx^V  ^  T, 


t=i 


i=l 


i=l 


and  $2  e  >C(X,F)  hy  =  Y  E  >X  y„  x  e  X.  Then  ^  $ 

.=1  j=i  ‘ 

OO  OO  /  -^2  OO  OO 

and,  since  lii^  \/57  =  0  and  E  E  ( 

1=1  j=i 


it  follows  that  is  compact  and  e  H S{X,Y). 
Lemma  3.4 


E  F-  E  =  E  Sf  =  E  <  OO, 

i=I  j=] 


1=1 


1=1 


(a)  For  every  $  e  ?t,  lim  jPn^Pn  -  =  0. 

(b)  For  every  $  e  V,  lim  ||P„$P„  -  ^IL  =  0. 

n— ♦^oo  ^ 

Proof  (a).  For  $  e  H  we  have 

IP.^Pn  -  ^\n  <  \Pn^Pn  “  Pn^\n  H  +  |P„$  -  $1^ 

<|$P„-$1^  +  |P„$-$1„ 

=  i($p„r-$*i^  +  ip„$-$i^ 

=  |p„$*-$*i„  +  ip„$-$i„ 

where  in  the  above  estimate  we  have  used  the  fact  that  P„  e  C{H)  with  |P„1  <  1 
and  that  IPn^'j-w  <  |P„|  for  every  'i'  e  "K.  If  we  apply  Lemma  3.3  with 

X  —  Y  =  H  to  eli.  =  HS{H^  H)^  then  we  obtain  $  =  =  ($*)^($*)^ 

with  e  C{H)  compact  and  e  HS{H,H).  It  follows  that 

iPn$*  -  =  i(p„  -  i)(^*)H^*y\n  <  i(^n  -  , 

and 

|Pn$-$|^<|(P„-/)$^||$2|^, 

which  together  with  assumnption  (3.1)  and  the  fact  that  and  ($*)*  are  compact 
yield  the  desired  result. 

(b).  For  $  e  V  =  HS{V\H)n  HSiH,V)  we  have 

IPn^Pfi  —  ^\hS(V,H)  ^  \Pn^Pn  —  |//5( y* ,//)  +  l-Pri^  —  ^\hS(V*,H) 

<  |P„|  |$P„  -  ^\hS{V,H)  +  “  ^l//S(V,//) 

^  l^-Pn  “  ^l//S(V,//)  +  |T*n$  —  ^\hS{V  ,H). 
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Now  $  e  HS{V* ,  H)  implies  that  c  HS{H,V*)  and  that  ($P„)*  = 

e  HS{H,  F*)  where,  recalling  Lemma  3.1,  P*  =  'yPn‘y~^  is  the  adjoint  of  the 
operator  Pn  considered  as  an  element  of  £(F*).  It  follows  that 

(3.4)  \Pn^P„  —  ^\hS{V,H)  —  l^n^*  “  ^*\hS(H,V)  +  l-Pn^  —  ^l//S(V*,H) 

Lemma  3.3  with  X  =  H  and  Y  =  V*  together  with  Lemma  3.1  imply  that  the  first 
term  on  the  right  hand  side  of  the  estimate  (3.4)  tends  to  zero  as  n  — >  oo.  Similarly, 
Lemma  3.3  with  X  =  V*  and  Y  =  H  together  with  assumption  (3.1)  imply  that 
the  second  term  tends  to  zero  as  n  — >  oo  as  well.  A  similar  argument  to  the  one 
given  above  can  be  used  to  show  that  lim  jPn^Pn  —  ^\hs(H  u)  ~  ^  lemma 

is  proved. 

The  primary  result  of  this  paper  is  given  in  the  following  theorem. 

Theorem  3.1  Let  11  c  V  be  the  unique  solution  to  the  equation  (2.5)  (equivalently 
(2.3))  and  for  each  n  =  1,2,...  let  !!„  c  'Hn  be  the  unique  solution  to  the  approxi¬ 
mating  operator  equation  (3.3).  Then  lim  ||n„  —  n|L  =  0. 

Proof  From  the  triangle  inequality  we  obtain 


lin„  -  niiv  <  lin„  -  p„np„iiv  +  ll^nnp„  -  nii^ . 

An  application  of  Lemma  3.4(b)  yields  that  the  second  term  on  the  right  and  side 
of  the  above  estimate  tends  to  zero  as  n  — ►  oo.  As  for  the  first  term,  we  recall  (2.4) 
and  consider  the  estimate 

u;  i|n„  -  Pniip^wl  <  -  p„np„},n„  -  p„np„]« 

=  -F  B„(n„)  -An-  p(n),  n„  -  p„np„]^ 

-t-[>tn  -  .4P„np„,n„  -  p„np„]« 

-h[5(n)  -  e(p„np„),n„  -  p„np„]7< 

+[B(P„nPr,)  -  n„  -  p„np„]7< 

=  [0„-0,n„-p„np„]w 
+[A{n  -  p„np„},  n„  -  p„np„]« 

+[B{n)  -  5(p„np„),  n„  -  p„np„]^ 

-[p„p(n„)p„  -  p(p„np„),n„  -  Pnnp„]w 

=  [p„0p„-0,n„-p„np„]« 

+[^{n  -  p„np„},n„  -  p„np„]« 

+[B{n)  -  B(p„np„),n„  -  p„np„]« 

-[B(n„)  -  P(Pnnp„),  n„  -  p„np,.]„ 

<[p„0p„-0,n„-p„np„]« 

+{A{U  -  p„np„},  n„  -  p„np„]w 


-10- 


+[5(n)  -  BiPniiPn),  n„  -  p„np„]w 

where  in  the  final  estimate  above  we  have  applied  assumption  (2.1).  Continuing  we 
find  that 

a;  ||n„  -  PnllPnWl  <  WPnOPn  ~  0||v.  Pn  -  P„nP„P 

■fi  l■^l£(V  V*)  11^  ~  PnllPnllv  IP”  PnnPn||y 

+  \\B(U)'-  P(P„nP„)llv.  Pn  -  PnHPnllv  , 

or,  recalling  the  continuous  embedding  of  H  into  V*,  that 

Pn  -  PnHPnP  <  K  1P„0P„  -  0|^  +  P  "  PnTlPnWy 

+A'iP(n)-6(P„np„)|^.’ 

Lemma  3.4  together  with  the  continuity  assumption  on  B  imply 

lim  ||n„  -  p„np„iiy  =  0 

n— *00 

and  the  theorem  is  established. 

4.  An  Example 

In  order  to  illustrate  the  application  of  our  thoery  we  consider  an  operator  alge¬ 
braic  Riccati  equation  arising  in  the  design  of  an  optimal  feedback  control  law  for  a 
one  dimensional  heat/diffusion  equation.  Let  H,U  =  £2(0,!),  both  endowed  with 
the  usual  inner  product,  =  fg  ip('q)xp{T})dTj,  and  consider  the  linear-quadratic 

optimal  control  problem  of  finding  u  t  L^iO^C/o^U)  which  minimizes  the  quadratic 
performance  index 

rOO 

J(w)=  /  {Qx{t,-),x{t,-)) +  r{u{t,-),u{t,-))dt 

Jo 

subject  to  the  linear  dynamical  system 

(4.1)  =  bu{t,Tj),t  >  0,0  <  T/  <  1, 

(4.2)  a:(<,0)  =  0,  x(<,l)  =  0,  <>0 

(4.3)  x{0,ri)  =  x°{r]),  0  <  77  <  1, 

where  Q  is  a  self-adjoint,  nonnegative,  and  Hilbert-Schmidt  operator  from  £-2(0, 1) 
into  ^2(0,1), a  e  Loo(0, 1),  0(77)  >  a  >  0,  a.e.  77  e  (0,1),  6  e  R,  and  x®  e  £2(0,!). 
If  we  define  C  =  {$  e  P5(L2(0, 1), £^2(0, 1)), ^  >  0},  then  Q  e  C  and 

iQ^)iv)  =  fo  9(^>CV(CMC  with^e  £:2((0,1)x(0,1)),  9(77,0  =  g(C,r}),  q(rf,0  >  0, 
a.e.  (77,0  e  (0,1)  x  (0,1). 

Define  V  =  IIg(0,l)  endowed  with  the  standard  inner  product,  <  (f,  ip  >  — 
fg  Dip(T})Dip(Tj)dr/  and  corresponding  norm,  |j  •  ||.  It  follows  that  V  is  densely,  con¬ 
tinuously,  and  compactly  embedded  in  H,  that  V*  =  and  that  H  is 


densely  and  continuously  embedded  in  V*.  Define  the  operator  A  e  C{V,V*)  by 
V’)  =  for  c  V.  It  follows  that  (A(p,ip)  >  a|(<^|p,  <f  e  V,  and 

that  the  restriction  —A  of  the  operator  -A  to  the  set  Dom{A)  =  {(y?  e  V"  :  Atp  e  H] 
(=  H^{0, 1)  n  i/o(0, 1)  when  a  is  suffciently  smooth)  is  densely  defined  in  H,  nega¬ 
tive,  self-adjoint,  and  it  is  the  infinitesimal  generator  of  a  uniformly  exponentially 
stable  analytic  semigroup,  {T(t)  :  <  >  0}  of  bounded,  self-adjoint  linear  opeators  on 
H.  The  solution  to  the  initial-boundary  value  problem  (4.1)-(4.3)  is  given  by 


x(<)  =  T(t) 


x»+  f 
Jo 


T(t  —  s)bu{s)ds,  t>0 


where  for  each  <  >  0  x{t)  =  e  H  =  L2(0, 1)  and  u{t)  =  u{t,  ■)  e  U  =  1/2(0, 1) 

for  almost  every  #  >  0. 

The  solution  to  the  optimal  control  problem  (see  [5])  is  given  in  closed-loop  linear 
state  feedback  form  by 

u(t)  =  —(b/r)Ux(t),  a.e.  t  >  0 

where  11  is  the  unique  nonnegative  self-adjoint  solution  to  the  algebraic  Riccati 
equation 

(4.4)  A*n  +  UAA{b‘^/r)U'^  =  Q. 

It  is  clear  that  the  existence-uniqueness  and  approximation  theories  presented  above 
apply  with  Q  =  Q  e  C  and  B($)  =  {b^ /r)^^  for  $  e  C.  It  follows  that  there  exists  a 
unique  solution  11  e  HS(L2(0, 1),X2(0, 1))  to  the  nonlinear  operator  equation  (4.4) 
with  n  =  n*,n  >  O,  and  n  e  ff5(L2(0,l),ffi(0,l))nif5(if-i(0,l),l2(0,l)).  Re¬ 
calling  that  HS{L2{0,  1),  1/2(0, 1))  is  isometrically  isomorphic  to  I/2((0, 1)  x  (0, 1)), 
U  €  C  implies  that  there  exists  tt  e  X2((0, 1)  x  (0,1))  with  =  Tr{(,r})  and 

7r(T7,  C)  ^  0  for  almost  every  (r/,  C)  e  (0, 1)  x  (0, 1)  for  which 


u{t,r])  =  ~{b/r)  [  7r(T7,C)a:(t,C)<^C, 
Jo 


for  almost  every  77  e  (0, 1)  and  #  >  0. 

We  introduce  linear  spline  based  approximation.  For  each  n/=2,3,...  let  Hn  = 
span  where  for  j=l,2,...,n-l,  denotes  the  jth  standard  linear  spline  func¬ 

tion  defined  on  the  interval  [0,1]  with  respect  to  the  uniform  mesh  {0,  l/n,2/n,...,l). 
More  precisely, 


7777  —  y  -j-  1 
j  +  I  —  nrj 
0 


0  <  77  <  7  ^  /  7^ 

<  V  <j/n 
j In  <  T]  <  j  +  l/n 
j  +  l/n  <ri  <  1, 
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j=l,2,...,n-l.  Let  Pn  :  H  Hn  denote  the  orthogonal  projection  of  H  onto  Hn 
with  respect  to  the  usual  inner  product  on  H  =  L2(0il)  and  define  Galerkin  ap¬ 
proximations  An  e  J0.{Hn)  to  A  in  the  usual  way.  That  is  let  A„(y3„  =  t/>„  where 
for  (fn  f  Hni^Pn  is  the  unique  element  in  Hn  which  satisfies  Xn)  =  (0ni  Xn)» 

Xn  e  Hn.  Set  Qn  =  PnQ  ^  C,{Hn). 

Using  well  known  approximation  properties  of  linear  interpolatory  splines  (see  [7]) 
it  is  not  difficult  to  argue  that  lim  ||Pn9  ~  <^||  =  0.  e  Hq{0,  1)  and  consequently 

n — >00 

that  assumption  (3.1)  is  satisfied.  It  follows  therefore,  from  the  theory  presented 
in  section  3  above,  that  there  exists  a  unique  nonnegative  self-adjoint  operator 
Hn  e  C{Hn)  satisfying  the  algebraic  Riccati  equation  in  Hn  given  by 

(4.5)  UnA  ibyr)Ul  =  g„. 

Moreover,  we  have  the  Hilbert-Schmidt  norm  convergence  of  IlnPn  to  11  as  n  — >  oo. 
That  is 

('^•^)  |n„Pn  -  =  0. 

We  in  fact  also  obtain  that  lim  |n„P„  —  V)  ~  ^ 

=  0- 

From  a  computational  point  of  view,  since  the  basis  elements  are  not  mu¬ 
tually  orthonormal,  simply  replacing  the  operators  in  the  finite  dimensional  alge¬ 
braic  Riccati  equation  (4.5)  with  their  corresponding  matrix  representations  will 
not  lead  to  the  usual  symmetric  matrix  Riccati  equation  for  which  a  variety  of 
computational  solution  techniques  exist.  Toward  this  end,  for  a  linear  opera¬ 
tor  Ln  with  domain  and/or  range  in  Hn,  we  denote  its  matrix  representation 
with  respect  to  the  basis  for  H„  by  Ln.  Define  </>„  :  [0,1]  R”“*  by 

<i>n{v)  =  ■  ■  ■  ,<fn~Hv)V  and  set  Mn  =  {(f>n,<f>l)  = 

fo  ^ni'n)4>n{'n)^'n-  if'  then  follows  that  An  =  M'^^{aD<j)n,D<f>^)  with 

A)^  =  AJ/Mn,  and  Qn  =  <(>„).  If  we  set  Qn  =  MnQn  and 

II/v  =  MnTIn,  then  Ilyv  is  the  unique  nonnegative  self-adjoint  solution  to  the 

(n  —  l)x(n  —  1)  matrix  algebraic  Riccati  equation  given  by 

(4.7)  +  RtvAat  -t-  {b'^ /r)UNMj^^flN  =  Qn- 

The  approximating  optimal  control  laws  take  the  form 

Un{i,rf)  = -(b/r)  f  nn{v,Ox{tX)dC 
Jo 
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for  almost  every  rj  e  (0, 1)  and  t  >  0  where 

7r„(r,,C)  =  <?in(r/)^A/^'nNMj^Vn(C), 

(77, (^)  e  [0,1]  X  [0,1].  It  follows  from  (4.6)  that  lim  7r„  =  tt  in  L2((0,l)  x  (0,1))  - 

n— *00 

that  is  that 

(4.8)  J^fo  fo  Mn,<)  -  d(dT). 

To  illustrate  we  take  a(ij)  =  a  >  0,  a  constant,  and  let  Q  e  HS(L2(0, 1),  ^2(0, 1)) 
be  the  finite  rank  modal  projection  operator  given  by 

1/ 

=  Y^qk{<p,^k)^k,  (,?€  12(0,1) 

fc=i 

where  t/  <  00,  rpki'n)  =  \/2sinfc7r7/,  T)  e  [0,1],  k  =  1,2,  ...,i7,  and  >  0,  A:  = 
1,2, ...,!/.  A  somewhat  tedious,  but  rather  straight  forward  computation  yields 

t/ 

{QN)ij  =  ^"^qk^ki^kj^  bj  =  1,2, ...,n  -  1, 

k=i 


where 


.  +1)  „  .  ,  7r£ 

sin  k - 2  sin  k —  +  sin  k 

n  n 


1)  1 

n  ]  ’ 


k  =  1,2,  ...,!/,£  =  1,2,  ...,n  —  1.  Setting  a  =  .25,  b  =  1.0,  r  =  .01,  =  3, 

and  qi  =  q2  =  qs  =  1-0,  and  using  Schur- vector  decomposition  of  the  associated 
Hamiltonian  matrix  (see  [4])  to  solve  the  matrix  Riccati  equation  (4.7)  for  various 
values  of  n  we  obtained  the  kernels,  7r„,  plotted  in  the  figures  below.  That  the 
conv^ergence  given  in  (4.8)  above  is  achieved  is  immediately  clear. 


Figure  4.1d:  7r32(T7,C),  (j?,C)  £  [0,1]  x  [0,1]. 
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